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Abstract 

Optimisation  solvers  should  learn  to  improve  their  performance  over  time.  By  learning 
both  during  the  course  of  solving  an  optimisation  problem  as  well  as  across  multiple 
optimisation  problems,  we  have  demonstrated  significant  advances  in  the  state  of  the 
art  in  scheduling,  packing  and  related  resource  constrained  combinatorial  optimisation 
problems. 


Introduction 

Optimisation  has  traditionally  been  treated  as  a  one-off  task.  In  practice,  optimisaiton 
is  a  lifelong  process.  Tomorrow’s  optimisation  problem  can  be  viewed  in  the  context 
of  todays  and  yesterday’s.  For  example,  we  might  want  to  optimise  the  schedule  of 
activities  today,  but  this  is  likely  to  be  a  similar  problem  to  yesterdays,  as  well  as  to 
tomorrow’s.  In  addition,  we  should  view  todays  schedule  in  terms  of  the  schedule  for  the 
whole  week.  For  instance,  if  a  particular  worker  was  assigned  to  loading  yesterday  and 
today,  we  might  prefer  that  they  do  so  again  tomorrow  as  they  are  likely  to  prefer  such 
regularity  and  to  be  more  effective.  This  grant  set  out  to  shift  the  prevailing  paradigm  of 
optimisation  from  an  one-off  task  to  one  that  is  repeated  and  lifelong.  There  were  two 
main  goals:  learning  from  past  solving  attempts  and,  as  a  necessary  part  of  gaining  trust 
over  time  and  for  learning  from  the  past,  developing  methods  to  explain  solutions.  The 
benefits  to  the  Department  of  Defence  are  to  advance  the  state  of  the  art  in  combinatorial 
optimization  (for  example,  by  closing  open  results  in  scheduling),  and  to  develop  new 
methods  to  deal  with  uncertainty  and  change. 


Results 

Lazy  clause  generation 

Our  major  learning  method  is  lazy  clause  generation,  a  novel  combination  of  Constraint 
Programming  (CP)  and  Learning.  This  has  vastly  improved  the  way  that  solvers  infer 
and  learn  in  combinatorial  optimisation  problems  involving  limited  resources.  The  basic 
idea  is  very  simple:  dont  repeat  search  mistakes  by  recording  reasons  from  past  failures. 
We  have  showed  how  we  can  reuse  such  learning  across  optimization  problems  [6],  By 
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closing  numerous  open  problems,  we  demonstrated  that  such  lazy  clause  generation  im¬ 
proves  the  state  of  the  art  in  solving  difficult  optimisation  problems  in  two  challenging 
benchmark  domains:  project  and  flexible  job  shop  scheduling  [10, 11],  We  also  looked 
at  symmetry  across  optimisation  problems  [7, 1].  This  work  was  recognized  with  the 
Best  Paper  award  at  the  18th  International  Conference  on  Principles  and  Practice  of 
Constraint  Programming. 

Learning  heuristics 

To  cope  with  dynamic,  online  optimisation  problems  with  uncertainty,  we  developed 
some  powerful  and  sophisticated  techniques  for  learning  heuristics,  rules  of  thumb  for 
making  decisions  [16].  We  have  recently  started  to  apply  this  to  an  interesting  pickup 
&  delivery  problem  for  collecting  and  delivering  food  donated  to  FoodBank  Australia 
[14,15], 

Meta-optimisation 

By  formalizing  aggregator  constraints  we  developed  a  very  general  and  useful  class 
of  meta-optimization  problems  called  nested  optimisation  problems  [8].  This  permits 
us  to  specify  and  reason  about  optimisation  problems  involving  uncertainty.  Nested 
optimisation  problems  subsumes  several  existing  classes  including  quantified  Boolean 
formulae,  multi-level  stochastic  optimization,  and  bi-level  programming.  By  develop¬ 
ing  methods  to  explain  propagation  for  this  class  we  provide  exponential  reductions  in 
search,  and  allow  the  direct  specification  of  lifelong  optimization  problems  as  a  single 
meta-optimisation  problem. 

RAAF  prototype 

Following  a  visit  to  Travis  in  August  2012,  and  discussions  with  TRANSCOM,  we  be¬ 
gan  a  pilot  project  with  the  RAAF  on  solving  their  logistics  problems.  We  have  imple¬ 
mented  a  prototype  solver  and  explored  both  constraint  and  mathematical  programming 
approaches  to  the  problem.  The  prototype  works  on  an  “australian-scale”  problem  with 
hundreds  of  requests  to  tens  of  locations.  We  are  currently  extending  it  to  cope  with 
crewing  constraints,  and  to  scale  up  to  larger  networks  using  automatic  decomposition 
techniques.  Our  end  goal  is  to  productise  this  research  so  it  can  be  fielded  in  the  real 
world.  Figure  1  gives  a  screenshot  from  the  prototype  in  action. 

Esteem  measures 

Peter  Stuckey  presented  our  work  on  lazy  clause  generation  as  a  keynote  talk  at  the  16th 
International  Conference  on  Theory  and  Applications  of  Satisfiability  Testing  in  August 
2013  [12],  at  the  19th  International  Conference  on  Principles  and  Practice  of  Constraint 
Programming  in  September  2013  [13],  and  at  the  15th  International  ACM  Symposium 
on  Principles  and  Practice  of  Declarative  Programming  in  September  2013. 

Toby  Walsh  presented  the  work  on  learning  heuristics  as  the  keynote  talk  at  the 
3rd  International  Workshop  on  Statistical  Relational  AI  (held  alongside  the  AAAI  2013 
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Fig.  1.  Screen  shot  from  RAAF  prototype  logistics  decision  support  tool. 


conference).  He  also  presented  the  keynote  at  the  27th  German  Conference  on  Artificial 
Intelligence  (KI-2014),  and  the  12th  Foundations  of  Genetic  Algorithms  (FOGA  2013). 
He  was  awarded  a  prestigious  Humboldt  Research  Award  in  2014  in  recognition  of  his 
ongoing  contributions  to  the  research  field. 
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